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RESOLUTION ADAPTIVE IMAGE FILTERING SYSTEM AND 

METHOD 

BACKGROUND OF THE INVENTION 

The present invention relates to the field of digital imaging and image 
enhancement. More particularly, the invention relates to a technique for improving 
image enhancement by appropriately filtering input image data based upon an optimal 
sampling rate for the data. 

Many techniques are currently available and in use for creating digital images. 
The techniques range in complexity from simple photographic techniques to much 
more complex imaging modalities such as those used in medical imaging, part 
inspection, parcel and baggage inspection, and so forth. More complex imaging 
modalities include computed tomography (CT) imaging systems, magnetic resonance 
imaging (MRT) systems, digital X-ray imaging systems, and so forth. In all of these 
applications there is a continuing need for improvement of the resolution and clarity 
of images produced. Generally speaking, these improvements are made in post- 
processing steps in which the image data is manipulated through various calculations 
to enhance the clarity and general usefulness of the final reconstructed image. 

Current imaging systems produce images of differing spatial resolutions. A 
parameter known as the point-spread fimction of the systems is largely dependent 
upon imaging parameters, and results in such differing spatial resolutions. In CT 
images, for example, the particular reconstruction algorithm used to convert the 
acquired data to image data primarily determines the extent of the point-spread 
function. In MRI systems, similarly, the amount of zero-filled interpolation in the k- 
space data (the data acquired during an imaging sequence) affects the spatial extent of 
the point-spread function. In X-ray systems, the distance between the source and 
detector determines the point-spread function of the system. 
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Image filtering algorithms aimed at removing random noise from images do 
not currently account for this variation in the inherent spatial resolution. Accordingly, 
such algorithms perform sub-optimally in terms of image quality. Li such 
frameworks, a loss of spatial resolution in the filtered image often results, even as they 
5 may successfully reduce levels of random noise. 

There is a need, therefore, for an improved technique for filtering digital 
images. T here i s, a t p resent, a p articular n eed f or a t echnique t hat c an b e u sed i n 
different contexts and to accoimt for a different point-spread function bases. 

10 

BRIEF DESCRIPTION OF THE INVENTION 

The present invention provides a novel technique to image enhancement 
designed to respond to such needs. The technique is based upon an image filtering 
algorithm that reduces noise levels in the image without sacrificing spatial resolution of 
the filtered image. The technique automatically adapts to the variations in the intrinsic 
spatial resolution of the image being filtered, hi particular, the technique determines an 
optimal sampling rate, such as from the point-spread function of the image. It is also 
possible to estimate the point spread function by examining the bandwidth properties of 
the image. This optimal sampling rate is compared to an actual pixel sampling rate. 
Based upon the comparison, during filtering, the image can be shrunk accordingly to 
accommodate the optimal sampling rate. Altematively, re-sampling of the data may be 
done in certain context. 

25 The invention contemplates methods, systems and computer programs designed 

to implement such techniques. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The foregoing and other advantages and features of the invention will become 
30 apparent u pon r eading t he f oUowing d etailed d escription a nd u pon r eference to the 

drawings in which: 
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Fig. 1 is a diagrammatical representation of an exemplary imaging system 
adapted to provide resolution adaptive image filtering in accordance with the present 
techniques; 

5 Fig. 2 is a diagram of an exemplary discrete pixel image made up of a matrix 

of pixels having varying intensities defining structures and non-structures to be 
enhanced by the present techniques; 

Fig. 3 is a diagrammatical representation of certain functional components of a 
10 system for providing resolution adaptive image filtering in accordance with the 

present techniques; 

Fig. 4 is a more detailed representation of an implementation of the system of 

Fig. 3; 

15 

Fig. 5 is a graphical representation of the affects of imaging systems on 
idealized points providing a point-spread fimction which is accommodated by the 
present techniques; and 

20 Fig. 6 is a flow chart illustrating exemplary steps in logic for providing 

resolution adaptive image filtering in accordance with the present techniques. 

DETAILED DESCRIPTION OF SPECIFIC EMBODIMENTS 

25 Referring to Fig. 1, an imaging system 10 is depicted as including a scanner or 

data acquisition system 12 coupled to circuitry for acquiring and processing discrete 
pixel data. Signals sensed by the system 12 are encoded to provide digital values 
representative of the signals associated with specific locations on or in the subject, and 
are transmitted to the image acquisition circuitry 22. The image acquisition circuitry 22 

30 also provides control signals for configuration and coordination of system operation 

during image acquisition. The image acquisition circuitry 22 transmits the encoded 
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image signals to an image processing circuit 24. The image processing circuit 24 
executes pre-established control logic routines stored within a memory circuit 26 to filter 
and condition the signals received firom the image acquisition circuitry 22 to provide 
digital values representative of each pixel in the acquired image. These values are then 
5 stored in the memory circuit 26 for subsequent processing and display. Alternately, the 

image acquisition circuitry 22 may transmit the encoded image signals to the memory 
circuit 26. The image processing circuit 24 may subsequently acquire the signals fi-om 
the memory circuit 26 for the filtering and conditioning steps described below. 

10 The image processing circuit 24 receives configuration and control commands 

fi-om an input device 28 via an input interface circuit 30. T he input device 28 will 
typically include an operator's station, keyboard and other input devices for selectively 
inputting configuration parameters and for commanding specific image acquisition 
sequences. The image processing circuit 24 is also coupled to an output device 32 via 

15 an output interface circuit 34. The output device 32 will typically include a monitor or 

printer for viewing and producing reconstructed images based upon the image 
enhancement processing carried out by the processing circuit 24. 

In the embodiment described, the image processing circuit 24, the memory 
20 circuit 26, and the input and output interface circuits 30 and 34 are included in a 

programmed digital computer. However, circuitry for carrying out the techniques 
described herein may be configured as appropriate coding in application-specific 
microprocessors, analog circuitry, or a combination of digital and analog circuitry. 

25 It should be noted that imaging system 12 may include any suitable type of 

imaging system or modality. For example, in a medical diagnostics imaging context, 
industrial contexts, parcel and baggage inspection and handling contexts, the system 
may include a CT imaging station. Similarly, the system may include an MRI system, 
an X-ray system, or any other suitable modaUty. Other modalities presently 

30 contemplated may include tomosythesis systems, positron emission tomography 

systems, electron beam systems, ultrasound systems, among others. As summarized 
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below, all of the various systems will produce digital data which can be filtered and 
enhanced in accordance with the present techniques. It should also be noted that, while 
references made hereinto processing within the imaging system, many of the techniques 
described herein can and will be applied in post-processing steps. That is, the 
5 processing may be carried out in real time or in near real time with image acquisition, or 

after acquisition and storage of image data. Thus, the image filtering and enhancement 
techniques described herein may be carried out remotely fi-om the imaging system, as on 
completely separate and independent workstations that access the image data, either raw, 
processed or partially processed and perform the steps and fimctions described herein to 
1 0 improve the ultimate reconstructed image. 

Fig. 2 illustrates an exemplary discrete pixel image 50 produced via the imaging 
system 10. The image 50 is composed of a matrix of discrete pixels 52 disposed 
adjacent to one another in a series of rows 54 and columns 56. These rows and colimms 

15 of pixels provide a pre-established matrix width 58 and matrix height 60. Typical 

matrix dimensions may include 256 X 256 pixels; 512 X 512 pixels; 1,024 X 1,024 
pixels, to name just a few. In certain systems the particular image matrix size may be 
selected via input device 28 (see Fig. 1) and may vary depending upon such factors as 
the subject to be imaged the resolution desired and the physics or characteristics of the 

20 imaging system. 

As illustrated in Fig. 2, the exemplary image 50 includes structural regions 62, 
illustrated as consisting of long, contiguous lines defined by adjacent pixels. The image 
50 also includes non-stmctural regions 64 lying outside of the structural regions 62. The 

25 image 50 may also include isolated artifacts 66 of various sizes (i.e., number of adjacent 

pixels), which may be defined as structural regions, or which may be eliminated fi-om 
the definition of structure in accordance with generally known techniques. It should be 
noted that while reference is made in the following discussion to intensity values within 
an image, such as the exemplary image 50, the present technique may also be used to 

30 process other parameters encoded for the individual pixels 52 of an image. Such 

parameters might include fi-equency or color, and not merely intensity. 
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In accordance with the present techniques, the acquired or processed image data 
forms what may be referred to as an input image. It should be xmderstood that this input 
image, and other images referred to herein, are actually image data processed by the 
present techniques. The ultimate reconstructed image is, however, a visual presentation 
5 that can be viewed by a user. The present technique allows for manipulation of the input 

image to accoimt for the particular point-spread function of the imaging system. That is, 
the technique is spatially adaptive to the characteristics of the imaging system that 
produced the input image. Known algorithms for image filtering apply sets of spatial 
domain operations to reduce noise levels in the input image. Certain techniques perform 

10 such operations by shrinking the input image, in an operation that may be referred to as 

sub-sampling. This shrinking operation has the affect of normalizing the input 
resolution and makes use of redundancies in the input image. Previous techniques have, 
however, relied upon the image size to determine the degree of shrinking or sub- 
sampling. The present technique employs a more rigorous approach in which the 

15 amoxmt of sub-sampling done to shrink the input image depends upon the intrinsic 

spatial resolution of the image. In the present context, it may be considered that the 
inherent spatial resolution may depend on the point-spread function of the imaging 
system acquiring the image data and the sampling rate used to generate the discrete 
image. As described below, such information is used to determine the optimal sampling 

20 rate, which may be defined as the Nyquist rate of the imaging system. This value is used 

to determine the amount of sub-sampling or shrinking that is to be performed on the 
image prior to applying the spatial domain operations. The approach ensures that the 
optimal sampling criteria are not violated by under-sampling and that the maximum 
amount of sampling can be attained without loss of image information to perform 

25 filtering on the image with normalized resolution and to exploit redundancies in the 

image data. 

Fig. 3 represents a diagrammatical representation of a system for performing the 
fimctions of the present technique. The system, designated generally by reference 
30 numeral 68, may be implemented through hardware, software, firmware or a 

combination of these media. The system begins with an input image 70 produced by 
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any suitable imaging system. The input image is typically stored on a digital storage 
device and is accessed by the processing system for enhancement and improvement of 
the image quality. The system includes a filter 72 which is typically embodied in 
appropriate software code stored in the system. Certain aspects of the filter may follow 
5 generally known techniques as described further below. The filter makes use of 

shrinking or sub-sampling levels which are determined by a shrink parameter 
determining module 74. This module, in turn, receives inputs from an optimal sampling 
rate determining module 76 and an actual sampling rate determining module 78. As 
described below, based upon the optimal and actual sampling rates, the appropriate 
10 shrink parameter or sub-sampling level is determined and provided to filter 72. The 

filter then produces an output image 80 which includes data that can be reconstmcted 
into an enhanced image for viewing, storing, transmitting, and subsequent processing. 

As noted, certain elements of the filter 72 may follow lines generally known in 
15 the art. Fig. 4 represents certain of these known elements, but with enhanced 

components incorporating the present techniques. The implementing system, designated 
generally by reference numeral 82, begins with the input image 70 as noted above. At a 
step 84 the system shrinks the input image, or sub-samples the input image by a shrink 
parameter. As will be appreciated by those skilled in the art, such shrinking may be 
20 accompUshed by various sub-sampling techniques, including a pixel averaging, in which 

the digital values representative of intensities at each pixel are read and the image is 
shrunk by some factor X which is generally greater than 1 , In a present embodiment, a 2 
X 2 or 3 X 3 boxcar filter may be applied to obtain a non-overlapping average. Multi- 
dimensional factors may also be employed, such as2x3or3x2 filters. A multi- 
25 dimensional factor must be greater than 1 in at least on of the dimensions, such as 3 x 1 

or 1 X 3. To obtain non-overlapping averages, the pixels of the image may be mirrored 
at the boundaries when needed. 

The filter 72 serves to identify and process structural features of the input image 
30 and non-stmctural features or regions. Thus, at block 86 of Fig. 4, routines are 

performed for identifying structures 88 within the normaUzed image, and differentiating 
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such structures from non-structures 90. The structures are then processed by anisotropic 
smoothing as indicated at block 92, followed by sharpening, as indicated at block. The 
non-structure, on the other hand, is processed by isotropic smoothing, as indicated at 
block 96. The processed structure and non-structure then forms a filtered i mage, as 
indicated at reference numeral 98 in Fig. 4. 

At block 100, the structure and non-structure data is expanded by the same factor 
by which the image was shrunk or sub-sampled at block 84. The resulting expansion 
produces an expanded structure mask and an expanded image, both of which have the 
same dimensions as the input image. At block 102, then, texture present in the input 
image is blended back into the expanded image to produce the output image 80. The 
blending process typically utilizes the expanded structure mask to allow differential 
texture blending of structure and non-structure regions. 

It should be noted, and will be appreciated by those skilled in the art, that the 
exemplary steps and components of Fig, 4 are exemplary only. That is, other, different 
or additional modules and steps may be incorporated. By way of example, additional 
blending may occur in which high frequencies are differentially introduced into the 
blended image to produce a noise blended image. Certain of these techniques can 
further enhance image quality. The present techniques add to these and permit fiirther 
enhancement of image quality as will be described. 

As will be appreciated by those skilled in the art, depending upon the imaging 
modality, the point-spread function could be determined from various parameters which 
may be stored in a header section of an image data stream. For example, in CT images, 
the reconstruction algorithm employed primarily determines the point-spread ftmction of 
the imaging system. Because there are a finite number of reconstruction algorithms used 
in CT, it is possible to determine the point-spread function empirically that is associated 
with each reconstruction algorithm. Such associations may be placed in a look-up table 
and used within the present processing framework. For MRI systems, the point-spread 
functions is determined by the ZIP parameter which defines the highest frequency 
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content of any image generated from the system. Given the highest frequency content in 
the image, there are numerous methods in standard Fourier theory to determine the 
point-spread function of the imaging system. In X-ray systems, the point-spread 
ftmction can be computed from the source-to-detector distance and the source size. This 
5 information is also available, generally in the X-ray digital image data stream header. 

Thus, each type of imaging system generally has available techniques which permit 
identification of the point-spread functions. 

An exemplary illustration of the point-spread function is illustrated in Fig. 5. As 

10 shown in Fig. 5, the ideal situation 104 can be illustrated graphically, while the point- 

spread representation 106 is typically encoimtered in the actual implementation. With 
the image pixel dimensions generally represented by the horizontal axis 108 in Fig. 5, 
and pixel intensity indicated by the vertical axis, in an ideal situation each point is 
infinitely thin as indicated by reference numeral 110 in Fig. 5. However, due to the 

15 inherent limitations of the imaging systems, blurring occurs, resulting in a spread of the 

pixel dimensions, as indicated by trace 112 in Fig. 5. The present technique recognizes 
that when sampled at approximately twice the Nyquist rate, information loss can be 
substantially avoided. The Nyquist rate can be determined by taking the Fourier 
transform of the point-spread function. Alternatively, the Nyquist rate can be computed 

20 using standard image processing techniques, by examining the highest frequency 

harmonic in the image. Note however that even though this approach is useful, as it 
does not rely on system and acquisition parameters, it is quite susceptible to noise in the 
image. In practice, if the point-spread function is wide, the image may be quite blurred 
in appearance, requiring a higher degree of shrinking or sub-sampling in the processing 

25 steps described above. Moreover, the display field is generally considered, that is, the 

dimension of objects in the reconstructed image. A redundancy metric is determined 
based upon the display field as described below. That is, if many pixels are required to 
represent an object in the reconstmcted image, this fact implies a high degree of 
redundancy, and the input image may be shrunk a considerable degree. Thus, the degree 

30 of shrinking or sub-sampling also depends upon this redundancy metric. 
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Fig. 6 illustrates certain functional steps in logic for determining the appropriate 
shrinking or sub-sampling parameters and levels in accordance with the present 
technique. The process begins with determining the point-spread function of the system 
as indicated at step 114. As noted above, the point-spread function could be detemiined 
from a look-up table or may be calculated. By way of example again, the point-spread 
function may depend upon such factors as the reconstruction algorithm in CT imaging, 
the ZIP parameter in MR imaging, or the source-to-detector distance in digital X-ray 
imaging. From this point-spread function, then, the optimal sampling rate is determined 
by module 76. Known techniques are available for determining the optimal sampling 
rate, which may be generally considered the Nyquist rate based upon the point-spread 
function of the imaging system. Such techniques include use of a modulation transfer 
function, which employs the magnitude of the frequency response of the point-spread 
function. 

In parallel with this processing, the redundancy metric described above is 
determined. The redundancy metric is determined as illustrated in Fig. 6 by determining 
the pixel size, that is, the physical dimensions of pixels in the reconstructed image. As 
will be appreciated by those skilled in the art, this determination is based upon the 
display field of view and the image size, in pixels, and results in a metric having units of 
length (typically millimeters). The module 76, then, determines the pixel sampling rate 
from the pixel size. The sampling rate may generally be considered to be the inverse of 
the pixel size, resulting in a quantity measured in cycles per xmit length. 

The optimal sampling rate, which may be denoted So, and the pixel sampling 
rate, which may be denoted Sp are then compared as indicated at step 118. In general, it 
is preferred that the pixel sampling rate be at most the value of the optimal sampling 
rate. Thus, based upon the comparison at step 118, the optimal or desired shrink or sub- 
sampling parameter is determined. In a present implementation, as represented in Fig. 6, 
if the value of So is greater than or equal to the actual sampling rate Sp, the shrink 
parameter is set to a value of xmity. That is, the image is already sampled at a rate lower 
than the optimal sampling rate so any additional shrinking or sub-sampling will yield 
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under s ampling. O n t he c ontrary, i f t he o ptimal s ampling r ate i s 1 ess t han t he p ixel 
sampUng rate, the shrink or sub-sampling parameter is set to the value of Sp/So- That is, 
the image is sampled at a higher rate than the optimal rate, such that additional sampling 
can be done without losing image information. The value of Sp/So may be considered in 
5 the present context, the redundancy metric. The resulting parameter is then used in the 

processing described above for shrinking or sub-sampling the input image for filtering. 

It should be noted that in certain context, it may be possible to re-sample the 
image data based upon raw or pre-processed data. This possibility is indicated at step 
10 1 24 in Fig. 6. By way of example, if the redundancy metric is found to be greater than 1 , 

it may be possible to interpolate based upon the input image, such as in a fi-equency 
domain or other domain. Thus, the raw image data may be reprocessed, such as in case 
base for MRI data or Radon space for CT data to provide the desired sampling rate 
matching the optimal sampling rate. 

15 

Although the current invention is described as an application to filter parameter 
adjustments, other applications are also possible. For example, the redundancy metric 
can be used to alert the operator of a data acquisition system that sub-optimal data is 
being acquired. As another example, the redundancy metric can be used to set optimal 
20 display parameters for the image data. In another example, redundancy metric can be 

used to guide quantitation of images. In yet another example, redundancy metric can be 
used to set the parameters of image analysis. 

While the invention may be susceptible to various modifications and 
25 altemative forms, specific embodiments have been shown by way of example in the 

drawings and have been described in detail herein. However, it should be understood 
that the invention is not intended to be limited to the particular forms disclosed. 
Rather, the invention is to cover all modifications, equivalents, and altematives falling 
within the spirit and scope of the invention as defined by the following appended 
30 claims. 
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